Search for: All records

Abstract Data science skills (e.g., analyzing, modeling, and visualizing large data sets) are increasingly needed by undergraduates in the life sciences. However, a lack of both student and instructor confidence in data science skills presents a barrier to their inclusion in undergraduate curricula. To reduce this barrier, we developed four teaching modules in the Macrosystems EDDIE (for environmental data-driven inquiry and exploration) program to introduce undergraduate students and instructors to ecological forecasting, an emerging subdiscipline that integrates multiple data science skills. Ecological forecasting aims to improve natural resource management by providing future predictions of ecosystems with uncertainty. We assessed module efficacy with 596 students and 26 instructors over 3 years and found that module completion increased students’ confidence in their understanding of ecological forecasting and instructors’ likelihood to work with long-term, high-frequency sensor network data. Our modules constitute one of the first formalized data science curricula on ecological forecasting for undergraduates. 

Abstract Phytoplankton blooms create harmful toxins, scums, and taste and odor compounds and thus pose a major risk to drinking water safety. Climate and land use change are increasing the frequency and severity of blooms, motivating the development of new approaches for preemptive, rather than reactive, water management. While several real-time phytoplankton forecasts have been developed to date, none are both automated and quantify uncertainty in their predictions, which is critical for manager use. In response to this need, we outline a framework for developing the first automated, real-time lake phytoplankton forecasting system that quantifies uncertainty, thereby enabling managers to adapt operations and mitigate blooms. Implementation of this system calls for new, integrated ecosystem and statistical models; automated cyberinfrastructure; effective decision support tools; and training for forecasters and decision makers. We provide a research agenda for the creation of this system, as well as recommendations for developing real-time phytoplankton forecasts to support management. 

Abstract In ecology, it is common for processes to be bounded based on physical constraints of the system. One common example is the positivity constraint, which applies to phenomena such as duration times, population sizes, and total stock of a system’s commodity. In this paper, we propose a novel method for parameterizing Lognormal state space models using an approach based on moment matching. Our method enforces the positivity constraint, allows for arbitrary mean evolution and variance structure, and has a closed-form Markov transition density which allows for more flexibility in fitting techniques. We discuss two existing Lognormal state space models and examine how they differ from the method presented here. We use 180 synthetic datasets to compare the forecasting performance under model misspecification and assess the estimation of precision parameters between our method and existing methods. We find that our models perform well under misspecification, and that fixing the observation variance both helps to improve estimation of the process variance and improves forecast performance. To test our method on a difficult problem, we compare the predictive performance of two Lognormal state space models in predicting the Leaf Area Index over a 151 day horizon by using a process-based ecosystem model to describe the temporal dynamics. We find that our moment matching model performs better than its competitor, and is better suited for intermediate predictive horizons. Overall, our study helps to inform practitioners about the importance of incorporating sensible dynamics when using models of complex systems to predict out-of-sample. 

Abstract Near‐term ecological forecasting can be used to improve operational resource management in freshwater ecosystems. Here, we developed a framework that uses water temperature forecasting as a tool to predict the migrations of Atlantic salmon (Salmo salar) and European eel (Anguilla anguilla) between freshwater and the sea. We used historical observations of lake water temperature and fish migrations from an internationally important long‐term monitoring site (the Burrishoole catchment, Ireland) to generate daily probabilistic predictions (0%–100%) of when relatively large numbers of fish migrate. For this, we produced daily lake water temperature forecasts that extended up to 34 days into the future using Forecasting Lake and Reservoir Ecosystems (FLARE), an open‐source ensemble‐based forecasting system. We used this system to forecast lake water temperature conditions associated with percentile‐based fish migrations. Two metrics, P66 and P95, were used to indicate days with migrations in excess of 66% and 95%, respectively, of the historical daily fish counts. The results were first validated against water temperature observations, with an overall root mean squared error (RMSE) of 0.97°C. Our forecasts outperformed two other possible water temperature forecasting approaches, using site climatology (1.36°C) and site persistence (1.19°C). The predictions for fish migrations performed better for the P66 metric than for the more extreme P95 metric based on the continuous ranked probability score (CRPS), and the best results were obtained for the salmon downstream migration. This forecasting approach with quantified uncertainty levels has the potential to assist decision making, especially in the face of increased risks for these species. We conclude by discussing the scalability of the framework to other settings as a tool aimed at supporting management practices in real time. 

Abstract Water temperature forecasting in lakes and reservoirs is a valuable tool to manage crucial freshwater resources in a changing and more variable climate, but previous efforts have yet to identify an optimal modeling approach. Here, we demonstrate the first multi‐model ensemble (MME) reservoir water temperature forecast, a forecasting method that combines individual model strengths in a single forecasting framework. We developed two MMEs: a three‐model process‐based MME and a five‐model MME that includes process‐based and empirical models to forecast water temperature profiles at a temperate drinking water reservoir. We found that the five‐model MME improved forecast performance by 8%–30% relative to individual models and the process‐based MME, as quantified using an aggregated probabilistic skill score. This increase in performance was due to large improvements in forecast bias in the five‐model MME, despite increases in forecast uncertainty. High correlation among the process‐based models resulted in little improvement in forecast performance in the process‐based MME relative to the individual process‐based models. The utility of MMEs is highlighted by two results: (a) no individual model performed best at every depth and horizon (days in the future), and (b) MMEs avoided poor performances by rarely producing the worst forecast for any single forecasted period (<6% of the worst ranked forecasts over time). This work presents an example of how existing models can be combined to improve water temperature forecasting in lakes and reservoirs and discusses the value of utilizing MMEs, rather than individual models, in operational forecasts. 

Abstract Ecosystems around the globe are experiencing changes in both the magnitude and fluctuations of environmental conditions due to land use and climate change. In response, ecologists are increasingly using near‐term, iterative ecological forecasts to predict how ecosystems will change in the future. To date, many near‐term, iterative forecasting systems have been developed using high temporal frequency (minute to hourly resolution) data streams for assimilation. However, this approach may be cost‐prohibitive or impossible for forecasting ecological variables that lack high‐frequency sensors or have high data latency (i.e., a delay before data are available for modeling after collection). To explore the effects of data assimilation frequency on forecast skill, we developed water temperature forecasts for a eutrophic drinking water reservoir and conducted data assimilation experiments by selectively withholding observations to examine the effect of data availability on forecast accuracy. We used in situ sensors, manually collected data, and a calibrated water quality ecosystem model driven by forecasted weather data to generate future water temperature forecasts using Forecasting Lake and Reservoir Ecosystems (FLARE), an open source water quality forecasting system. We tested the effect of daily, weekly, fortnightly, and monthly data assimilation on the skill of 1‐ to 35‐day‐ahead water temperature forecasts. We found that forecast skill varied depending on the season, forecast horizon, depth, and data assimilation frequency, but overall forecast performance was high, with a mean 1‐day‐ahead forecast root mean square error (RMSE) of 0.81°C, mean 7‐day RMSE of 1.15°C, and mean 35‐day RMSE of 1.94°C. Aggregated across the year, daily data assimilation yielded the most skillful forecasts at 1‐ to 7‐day‐ahead horizons, but weekly data assimilation resulted in the most skillful forecasts at 8‐ to 35‐day‐ahead horizons. Within a year, forecasts with weekly data assimilation consistently outperformed forecasts with daily data assimilation after the 8‐day forecast horizon during mixed spring/autumn periods and 5‐ to 14‐day‐ahead horizons during the summer‐stratified period, depending on depth. Our results suggest that lower frequency data (i.e., weekly) may be adequate for developing accurate forecasts in some applications, further enabling the development of forecasts broadly across ecosystems and ecological variables without high‐frequency sensor data. 

Abstract Near‐term, iterative ecological forecasts can be used to help understand and proactively manage ecosystems. To date, more forecasts have been developed for aquatic ecosystems than other ecosystems worldwide, likely motivated by the pressing need to conserve these essential and threatened ecosystems and increasing the availability of high‐frequency data. Forecasters have implemented many different modeling approaches to forecast freshwater variables, which have demonstrated promise at individual sites. However, a comprehensive analysis of the performance of varying forecast models across multiple sites is needed to understand broader controls on forecast performance. Forecasting challenges (i.e., community‐scale efforts to generate forecasts while also developing shared software, training materials, and best practices) present a useful platform for bridging this gap to evaluate how a range of modeling methods perform across axes of space, time, and ecological systems. Here, we analyzed forecasts from the aquatics theme of the National Ecological Observatory Network (NEON) Forecasting Challenge hosted by the Ecological Forecasting Initiative. Over 100,000 probabilistic forecasts of water temperature and dissolved oxygen concentration for 1–30 days ahead across seven NEON‐monitored lakes were submitted in 2023. We assessed how forecast performance varied among models with different structures, covariates, and sources of uncertainty relative to baseline null models. A similar proportion of forecast models were skillful across both variables (34%–40%), although more individual models outperformed the baseline models in forecasting water temperature (10 models out of 29) than dissolved oxygen (6 models out of 15). These top performing models came from a range of classes and structures. For water temperature, we found that forecast skill degraded with increases in forecast horizons, process‐based models, and models that included air temperature as a covariate generally exhibited the highest forecast performance, and that the most skillful forecasts often accounted for more sources of uncertainty than the lower performing models. The most skillful forecasts were for sites where observations were most divergent from historical conditions (resulting in poor baseline model performance). Overall, the NEON Forecasting Challenge provides an exciting opportunity for a model intercomparison to learn about the relative strengths of a diverse suite of models and advance our understanding of freshwater ecosystem predictability.